Methods for retrieving database with image information

ABSTRACT

In a DB retrieval method, a two-step retrieval including quantitative and qualitative retrievals is interactively performed so that, through the operation of image information (e.g. map information) having a correspondence to a DB having text information such as attribute information stored therein, attribute information corresponding to the map information is retrieved from the DB. The quantitative retrieval includes a DB information reading process for reading image information, attribute information and information relevant thereto, and a quantitative retrieval process for making a quantitative retrieval including the partial overlaying of another information for retrieval on the original image information (or map information) or a rough retrieval with the other information used as a retrieval key called information lens, and storing the result of retrieval into a work file. The qualitative retrieval includes a DB information reading process for reading image information, attribute information and information relevant thereto, which are stored in the work file, and a qualitative retrieval process for making a qualitative retrieval in which the original image information (or map information) is overlaid with a retrieval key called a function sheet including the composition of a qualitative retrieval condition and an image indicative of a range of application of the retrieval condition, and displaying the result.

This is a continuation application of Ser. No. 08/935,541 filed Sep. 23,1997 now U.S. Pat. No. 5,144,956, issued Nov. 7, 2000, which is acontinuation application of Ser. No. 08/406,222 filed Mar. 16, 1995 nowU.S. Pat. No. 5,729,731.

BACKGROUND OF THE INVENTION

The present invention relates to a method for retrieving informationwith image information and text information being linked to each other,and more particularly to a method for retrieving information with aplurality of image information being overlaid with each other in alimited area.

The plan concerning an area has conventionally been made in such amanner that the feature or the like of that area are investigated byusing a map and detailed information is acquired by retrieving arelational information database (hereinafter abbreviated to DB)concerning that area. Usually, a describing language or SQL (StructuredQuery Language) for retrieval is used for the retrieval of DB.

For example, a retrieval system using text information has beendisclosed in JP-A-5-165401 entitled “MAP RETRIEVAL SYSTEM”. In thedisclosed system, a map database is retrieved with a telephone numberused as a key for getting the result of retrieval so that thecorresponding map is displayed and a marking is made at a position onthe map corresponding to the telephone number. In displaying the map, anaddress and a subscriber's name associated with the telephone numberacquired by retrieving the database are displayed.

Also, JP-A-4-155474 entitled “IMAGE PROCESSING METHOD AND SYSTEM” hasdiscloses a preferred image processing method in which attributeinformation of an area to be retrieved on an arrangement diagram such asa map or layout is outputted with a correspondence to an area on thearrangement diagram. The disclosed method includes inputting anarrangement diagram, inputting a figure to define the boundary of apredetermined area in the arrangement diagram by use of an image inputdevice, overlaying the inputted arrangement diagram with the boundarydefining figure, and storing the overlaid composition of the diagram andthe figure into a memory, thereby facilitating the processing ofinformation concerning the predetermined area in the arrangementdiagram.

A city planning operation is an example of a planning operation thatuses maps. In the city planning operation, development planning isinvestigated and made on a desk on the basis of various materials ordata. The materials include maps such as the city planning map,residential map and cadastral map, and information which is stored in adatabase (DB) and concerns residents and fixed properties.

In many cases, the city planning operation includes the followingstasks.

(1) A person acquires personal information concerning residents havingtheir homes in a designated area or landowners possessing their lands inthe area, administrative information concerning regulations defined inthat area, and information shown in various maps and makes mutualreference to the information.

(2) He processes a work similar to the above work (1) while partiallychanging the area. In this case, he may change conditions for acquiringthe other information while referring to the acquired information. Thus,the investigation of the planning about a plurality of areas requiresroughly getting the information of the areas and investigating each areawhile making the comparison with the rough information obtained for theareas.

(3) A work similar to the above work (1) is repeated by not onlychanging an area to be investigated but also selecting informationcorresponding to the investigation.

Namely, the planning operation is made in many cases in such a mannerthat the operation and investigation are made while simultaneouslyviewing a plurality of maps for the same area. For example, in the casewhere a plan of a new road is to be made, it is necessary for him toknow information concerning residents in areas along the new road by useof a residential map for the purpose of title negotiation and by using amap indicative of the ownership of lands to know information concerningthe landowners and regulations determined for the respective areas.

However, it is difficult for him to plan while simultaneously referringto the plurality of maps and confirming detailed resident informationand land information in the DB. The reason is that in the conventionalsystem, the map and the DB are realized without a relation to each otherand he must make the DB retrieval of relevant information whiledeparting from the map.

In many cases, it is conventional that information necessary for aplanning operation has its value in a locational relation (such asarrangement) displayed on a plan or diagram such as a map. In theconventional system, information retrieved from a DB is used in a formwritten down in the map. Therefore, the reference to the locationalrelation requires extra labor and a retrieval range is limited in manycases.

In the conventional system, since a system for displaying maps and asystem for retrieving DB's are realized as separate systems, it isrequired that the retrieval of the DB having information stored thereinand relevant to the maps should be made separately from the work ofusing the maps. For such circumstances, in the retrieval system usingtext information disclosed by JP-A-5-165401 entitled “MAP RETRIEVALSYSTEM”, the retrieval of DB information relevant to a map is made byretrieving a map database with text information of a telephone numberused as a key for getting the result of retrieval so that not only arelevant-map but also text information associated with the telephonenumber are displayed. However, this prior art has no disclosure asolution for globally understanding a map and selecting objects from themap.

On the other hand, in the method disclosed by JP-A-4-155474 entitled“IMAGE PROCESSING METHOD AND SYSTEM”, the processing of informationconcerning a predetermined area in an arrangement diagram is facilitatedby performing an image processing in which the arrangement diagram isoverlaid, by use of a marker, with a figure to define the boundary ofthe predetermined area in the arrangement diagram. However, this priorart has no disclosure as to a method of designating the predeterminedarea while making the trial of retrieval. Also, in the case where an SQLis used for retrieval, not only the retrieval requires considerablelabor but also it is impossible for him to make the direct observationof the change of information on a map in the process of retrieval in atrial-and-error manner.

SUMMARY OF THE INVENTION

An object of the present invention is to provide a DB (database)retrieval method in which when a DB having text information storedtherein and linked with image information such such a map is retrievedon the basis of the image information, a proper object of retrieval canbe selected from massive information of the DB on the basis of arelation of the image information to another image information and a DBretrieval condition and a range of application thereof can easily be setimagewise on the image information.

Another object of the present invention is to provide a retrieval methodwhich is capable of easily understanding the correspondence of pluralkinds of maps concerning the same area to detailed informationconcerning each map.

A further object of the present invention is to provide a method whichis capable of easily retrieving a DB relevant to a map by composing atleast one retrieval condition on the map as an image.

To that end, a two-step retrieval including a qualitative retrieval anda quantitative retrieval, which will be mentioned, is performed throughan interactive process. Though the operation of image information (forexample, map information) having the correspondence to a DB having textinformation such as attribute information stored therein, textinformation corresponding to the image information is retrieved from theDB. In the following, the attribute information is used as the textinformation.

1) The qualitative retrieval includes a DB information reading processfor reading image information, attribute information and informationrelevant thereto, and a qualitative retrieval process for making aqualitative retrieval including the partial overlaying of the firstimage information (for example, map information) with another imageinformation related with the first image information for retrieval or arough retrieval with another information used as a retrieval key to getthe result of retrieval and for storing the result of retrieval into awork file. The retrieval key used in the qualitative retrieval processis called information lens. The qualitative retrieval process selectsinformation from the information read through the DB information readingprocess. The result of selection is stored in the work file. The resultof selection is a partial assembly of the information read through theDB information reading process.

2) The quantitative retrieval includes a DB information reading processfor reading image information, attribute information and informationrelevant thereto, which are stored in the work file, and a quantitativeretrieval process for making a quantitative retrieval in which the firstimage information is overlaid with a retrieval key called a functionsheet including the composition of a quantitative retrieval conditionand an image indicative of a area of application of the retrievalcondition and for displaying the result of retrieval on a displaydevice.

In the case where the obtained result of retrieval is not preferable orin the case where another retrieval is made, either a processingincluding the repetition of the qualitative retrieval and thequantitative retrieval subsequent thereto or a processing including therepetition of only the quantitative retrieval can be selected on thebasis of a user's instruction.

The following processing is performed in the qualitative retrieval.

(1) In a DB information reading process, image information and textinformation stored in a DB are read and displayed on a display device.

(2) In a parameter setting process, a retrieval condition for thedisplayed image information is set.

(3) In an image information composing (or generating) process, anotherimage information necessary for retrieval is displayed in a compositeform with the above-mentioned image information on the basis of aninputted instruction.

(4) In a DB retrieval process, text information is retrieved from the DBon the basis of the retrieval conditions designated in the above items(2) and (3).

In the present invention, the generation or composition of imageinformation in the above item (3) includes the composition of imageinformation as will be mentioned in the following.

1) The other image information including detailed information iscomposed in a local area on the displayed image information.

2) A magnified version of another image information including detailedinformation is composed in a local area on the displayed imageinformation.

3) Another image information including detailed information is composedin a local area on the displayed image information and within an areawhich includes a position set by the user.

4) By use of the correspondence of the displayed image information toanother image information to be composed thereon, a modified version ofanother image information including detailed information is composed anddisplayed in a local area on the displayed image information.

The following processing is performed in the quantitative retrieval.

There is generated as image data a function sheet for composing thedesignation of an area to be retrieved and a DB retrieval condition. Aframe designating the area to be retrieved is generated as the imagedata of the function sheet and is displayed overlaying image data to besubjected to retrieval (or which is an object of retrieval). An areacorresponding to the image data of the function sheet is obtained ordetermined in accordance with a user's operation for the image data ofthe function sheet. A retrieval condition with the determined area takenas the area to be retrieved is generated as text information and the DBis retrieved on the basis of the text information.

According to the present invention, another image information isdisplayed in a form composed on image information displayed on a screen.With such a construction, it is possible to understanding another imageinformation in an intended area while seeing the state of theenvironment and to retrieve information corresponding to that area froma DB.

According to the present invention, a retrieval condition and an area ofapplication thereof are displayed as image data in a composite form withimage information. The displayed image data is operated to determine aposition at which the image data is displayed, that is, a position onimage data which is an object of retrieval. The determined area isinputted as a retrieval condition representative of an area to beretrieved. With such a construction, it is possible for a user to inputthe area to be retrieved without referring to text informationrepresentative of the position of the image information being displayed,thereby facilitating the input of the retrieval condition and the areaof application thereof.

BRIEF DESCRIPTION OF THE DRAWINGS

Further objects, features and advantages of the present invention willbecome more clear from the following detailed description of a preferedembodiment, described with respect to the accompanying drawing:

FIG. 1 is a diagram for explaining the outline of processes performed inthe present invention;

FIG. 2 is a diagram showing the construction of a computer system forembodying the present invention;

FIGS. 3A and 3B are diagrams showing the constructions of attributeinformation DB's;

FIG. 4 is a diagram showing the construction of an image information DB;

FIG. 5 is a diagram showing the construction of an image-attribute linkinformation DB in which the correspondence of the attribute informationDB to the image information DB is stored;

FIG. 6 is a diagram showing the structure of an information lens or afunction sheet format table;

FIG. 7 is a diagram showing the structure of an information lens or aninformation lens parameter table in which retrieval conditions arestored;

FIG. 8 is a diagram showing the structure of a table in which dataconcerning hit link points is stored;

FIG. 9 is a diagram showing the structure of a table in which acorrespondence between the first image information and the second imageinformation;

FIG. 10 is a flow chart showing a DB information reading process;

FIG. 11 is a flow chart showing a parameter setting process and an imageinformation generating process;

FIG. 12 is a flow chart showing a retrieval condition setting process;

FIG. 13 is a flow chart showing a DB retrieval process;

FIG. 14 shows a displayed example of a retrieval menu and DBinformation;

FIG. 15 shows a displayed example of a menu in the designation of theshape of an information lens;

FIGS. 16A and 16B show a displayed example of the overlaying of imageinformation by a lens;

FIGS. 17A and 17B show a displayed example of a retrieval conditionsetting menu;

FIG. 18 shows a displayed example of the result of retrieval with lens;

FIG. 19 shows a displayed example of the overlaying of image informationwith magnified image information;

FIGS. 20A and 20B show a displayed example on a screen before and afterthe transformation for image positioning;

FIG. 21 is an enlarged view of an image information portion subjected topositioning;

FIG. 22 is a diagram for explaining a modifying process for imagepositioning;

FIG. 23 is a diagram showing the structure of a function sheet parametertable in which retrieval conditions are stored;

FIG. 24 is a flow chart of a DB information reading process;

FIG. 25 is a flow chart of a retrieval process;

FIG. 26 is a flow chart for the setting of a retrieval condition;

FIG. 27 is a flow chart of a DB retrieval process;

FIG. 28 is a displayed example of a menu screen;

FIG. 29 is an example of a menu for inputting initial values of an areato be retrieved;

FIGS. 30A and 30B show a displayed example of a retrieval conditioninput screen;

FIGS. 31A and 31B show a displayed example for the input of a DBretrieval condition;

FIGS. 32A and 32B show a displayed example of the result of retrieval;

FIG. 33 shows a displayed example of the result of retrieval;

FIGS. 34A and 34B show a displayed example of the result of retrieval;and

FIGS. 35A and 35B show a displayed example of the result of DB retrievalusing a plurality of function sheets.

DESCRIPTION OF THE PREFERRED EMBODIMENTS

Embodiments of the present invention will now be explained in detail byuse of the accompanying drawings.

FIG. 1 is a diagram for explaining the outline of processes performed inthe present invention. In the overall processing shown in FIG. 1, atwo-step retrieval including a qualitative retrieval (in a process block800) and a quantitative retrieval(in a process block 900), which will bementioned, is performed through an interactive process so that, throughthe processing of image information (for example, map information)having the correspondence to a DB having text information such asattribute information stored therein, text information corresponding tothe map information is retrieved from the DB. In the following, theattribute information is used as the text information.

1) Qualitative Retrieval

The process block 800 includes a DB information reading process 810 anda qualitative retrieval process 805. The DB information reading process810 includes reading image information, attribute information andinformation relevant thereto. The qualitative retrieval process 805includes making a qualitative retrieval including the partial overlayingof the second image information related with the first image informationfor retrieval on the first image information (or map information) or arough retrieval with the second image information used as a retrievalkey to get the result of retrieval, and storing the result of retrievalinto a work file 2 a. The retrieval key used in the qualitativeretrieval process 805 is called an information lens. The details of theinformation lens will be mentioned later on. The qualitative retrievalprocess 805 selects information from the information read through the DBinformation reading process 810. The result of selection is stored inthe work file 2 a. The result of selection is a partial assembly of theinformation read through the DB information reading process 810.

2) Quantitative Retrieval

The process block 900 includes a DB information reading process 910 anda quantitative retrieval process 920. The DB information reading process910 includes reading image information, attribute information andinformation relevant thereto, which are stored in the work file 2 a,that is, various information selected by the qualitative retrieval. Thequantitative retrieval process 920 includes making a quantitativeretrieval in which the first image information is overlaid with aretrieval key called a function sheet including the composition of aquantitative retrieval condition and an image data indicative of a areaof application of the retrieval condition, and displaying the result ofretrieval on a display device.

In the case where the obtained result of retrieval is not preferable orin the case where another retrieval is made, either a processing (999 a)including the repetition of the qualitative retrieval 800 and thequantitative retrieval 900 subsequent thereto or a processing (999 b)including the repetition of only the quantitative retrieval 900 can beselected on the basis of a user's instruction.

FIG. 2 is a diagram showing the construction of a computer system forembodying the present invention.

A central processing unit (CPU) 1, an external memory (storage unit) 2,an input device 3 and a display device 5 are connected through a systembus 6. Attribute information DB's 100 and 110, an image information DB200 and a link information DB 300 are stored in the external memory 2.The CPU 1 is provided with a memory 4 which stores a program forexecuting the processing shown in FIG. 1 and various tables. The inputdevice 3 includes an indicator represented by a mouse or a pen inputdevice. The work file 2 a shown in FIG. 1 is also stored in the externalmemory 2.

The qualitative retrieval 800 is composed of the DB information readingprocess 810 and the qualitative retrieval process 805. The qualitativeretrieval process 805 includes a parameter setting process 820, an imageinformation generating process 830 and a DB retrieval process 840.

In the process 810, a data format of DB retrieval condition is generatedas a DB retrieval format table 500 a on the basis of the attributeinformation DB's 100 and 110 in which attribute information is stored.Further, there are read the image information DB 200 in which imageinformation is stored, an image-image link information DB 730 in whichthe correspondence between image information is stored and theimage-attribute link information DB 300 in which link information forlinking the image information and the attribute information DB with eachother is stored. The read DB information is displayed on the displaydevice 5.

In the process 810, image information to provide a reference(hereinafter referred to as first image information) and imageinformation to be composed thereon (hereinafter referred to as secondimage information) are read so that the first image information isstored and displayed and the second image information is only stored andthen fetched in the succeeding image information generating process 830.Usually, the first image information is predetermined. However, in thecase where the retrieval condition is complicated, a plurality kind ofsecond information may be read beforehand.

In a coordinate data table 400 is stored the more detailedcorrespondence of individual image information to each record of the DB.The coordinate data table 400 is linked with a part of the field of theDB 300. The details of the tables will be explained later on.

In the process 820, initial values concerning the information lens areset by an input from the input device 3 by a user and/or a settingvalues obtained from the table 500 a generated in the process 810,values prepared beforehand by the system and the preceding used value,and an information lens parameter table 600 a is generated by use of theinputted initial values, thereby setting parameters.

The information lens in the present invention includes the compositionof a table of various parameters which represents a display method, aretrieval method and a display method of the result of retrieval andimage data which represents an area to be displayed and an area to besubjected to retrieval. Image information in the display area of theinformation lens is called image information in lens area. An area to bedisplayed is called lens area and an area to be retrieved is called thefocus area.

The information lens has a lens area in which the first imageinformation is displayed in a form overlaid with a part of secondinformation a focus and a focus area which indicates an object ofretrieval of attribute information from the DB. In the case where thefirst image information is to be displayed in the form overlaid with thepart of the second image information, the second image information isdisplayed in a form modified so that the correspondence thereof to thefirst image information is recognizable. With the overlay of the part ofthe second image information, a limited area of the first imageinformation is displayed with information detailed more than itsenvirons, thereby providing a function such as an information lens ormagnifying lens for the first image information. In the case where theattribute information of DB is to be retrieved, a point a point in theimage information having a correspondence to the attribute informationis searched in the focus area and the DB retrieval is made by use of thecorrespondence to the first image information so that the result ofretrieval is displayed on the displayed information by use of charactersor graphics.

In the process 830, image information to be displayed on the displaydevice 5 is generated referring to the information lens parameter table600 a generated in the process 820 and the generated image informationis displayed in a composite form with image information which hasalready been displayed on the display device 5.

In the process 840, the DB retrieval is made on the basis of theinformation lens parameter table 600 a generated in the process 820 andwith reference to the DB 100, the DB 200, the DB 300, the table 400 andthe DB 730. Further, the result of retrieval is stored into a hit linktable 700 and the image data of the information lens and the result ofretrieval are displayed.

The correspondence of the processes 810, 820, 830 and 840 to the flowcharts of FIGS. 10 to 13 is indicated in the blocks of FIG. 1.

FIGS. 3A and 3B show the attribute information DB's 100 and 110 storedin the external memory 2. In the present embodiment, the DB 100 and theDB 110 are considered as the attribute information DB's. One DB or threeor more DB's may be used. Also, in the case where a plurality of imageinformation DB's and a plurality of attribute information DB's arelinked in various combinations, the combination of image information tobe first displayed and an attribute information DB is determined by auser in the DB information reading process 810 and the combination ofthe image information and the attribute information DB is changed in theparameter setting process 820 in accordance with the situation ofretrieval.

According to the present embodiment, in the case where a plurality ofDB's are used, the plurality of DB's can be referred through a kind ofimage information.

As shown in FIG. 3A, the attribute information DB 100 includes thecolumns of DB number 101, record number 102, attribute number 103, fullname 104, sex of subscribers 105, address 106 and birth data 107. The DBnumber 101 is a number peculiar to each DB. The DB number may be codedata representative of the name of each DB if it is a unique number tothe DB. The record number 102 is a consecutive number for distinguishingrecords in the DB from each other and may serve for the attribute number103, too. Each of the columns 104 to 107 includes attribute informationdata of attributes adapted for the contents of that item. For example, acharacter string is stored in the column 104 and the value of 0 or 1 isstored in the column 105.

As shown in FIG. 3B, the attribute information DB 110 includes thecolumns of DB number 111, record number 112, attribute number 113, nameof householder 114, address 115, site area 116 and name of landowner117. Since each column is fundamentally similar to that in the DB 100,the detailed explanation thereof will be omitted. It does notnecessarily follow that the item of each of the columns 113 to 117 isthe same in the respective attribute information DB's.

FIG. 4 shows the table structure of the image information DB 200 and animage data storage table 210. In the present embodiment, a map is usedas one example of image data. Maps represented by image data (or imagemaps) are stored in the columns 211, 212, 213, 214, - - - of the table210. In the case where there is a positional relation between imageinformation of the image maps, the image information is managed bydefining an origin for the image data to be displayed and moving each ofthe image information on the basis of the origin in order to representthe positional relation. The origin is defined in a coordinate system.This coordinate system is called absolute coordinate system andcoordinates in the absolute coordinate system are called absolutecoordinates.

The image information DB 200 includes the columns of image number 210,image name 202, type of image information 203, X and Y coordinates 204and 205 of the absolute coordinates of the origin of the image, leadingaddress 206 of the image information storage table. The image number isa number for distinguishing each image information uniquely. The imagename represents the contents of the image by a character string. Thetype of image information is data representative of the type or kind.For example, in the case where the image information is a map, the typeof image information is a map or the like represented by a residentialmap, a topographic map and an aerial photograph. The type of imageinformation includes the scale and accuracy of the map. In the casewhere the image information is a blueprint, the type of imageinformation is data representative of the type of the blueprint such asfront view, side view, layout, sketch drawing and cross section. Namely,the image name and the type of image information are information whichprovides marks of representation of the contents of the image by code ortext information.

Though not shown, image information representing the contents of eachimage information may be prepared separately. Such image informationincludes, for example, image information reduced to an extent in whichthe outline of the image information is recognizable, the version ofrepresentation of image information photographed by a camera ortelevision camera, or a handwritten drawing.

FIG. 5 shows the table structure of the link information DB 300 in whichlink information representing the correspondence of the first imageinformation to text information or attribute information is stored andthe coordinate data table 400 which represents the more detailedcorrespondence.

Link information representing the correspondence of image information totext information includes primary link information and secondary linkinformation. The primary link information includes the combination ofthe record number of each record of DB and coordinate datarepresentative of an object in image information corresponding to thatrecord and is stored in the table 400. An assembly including at leastone primary link information is called secondary link information, andlink information concerning the secondary link information is stored inthe DB 300.

The secondary link information is composed of link attribute, the nameof a creator of link information, creation date and identifier which arestored in the columns 301 to 310 of the DB 300. The link attribute 301includes link definition 302 and predetermined process 303. Theidentifier 306 includes a DB number 307, an image number 308, a leadingaddress 309 of the table 400 in which the primary link informationforming the secondary link information is stored, the number 310 ofprimary link information. The predetermined process is a processing forperforming a predetermined process in accordance with an input forinformation indicated by the identifier. For example, the predeterminedprocess, in the case where attribute information is changed, is aprocess for correcting image information with a correspondence to thechanged attribute information in accordance with a predetermined method.

Though an origin 1001 of image information 1000 is represented in theabsolute coordinate system of the image information DB, as has alreadybeen mentioned, the coordinates in the table 400 are represented interms of a coordinate system for each image (or relative coordinatesystem). Each object in image information is generally represented by aplurality of coordinates but may be represented by a representativepoint 1002 or 1003 provided in that object.

The provision of a representative point representing an object, as shownin FIG. 5, reduces a retrieval throughput at the time of retrieval ofprimary link information from an area to be retrieved, thereby enablingmore rapid retrieval.

FIG. 6 shows the structure of the DB retrieval format table 500 a. Thetable 500 a includes the columns of item number 501 for distinguishingthe item of a retrieval condition, content of item 502 and attribute ofitem 503. The contents of the attribute information DB's 100 and 110 arecopied into those columns with the reference being made to the DB's.

FIG. 7 shows the structure of the information lens parameter table 600a, a retrieval item table 620 a and an image data storage table 630 a.

The table 600 a includes the columns of lens number 601 a peculiar toeach information lens, origin of lens 602 a which is the origin of aposition representing the information lens, shape of lens 605 a, size oflens area 606 a, size of focus area 607 a, magnifying rate 608 a,leading address 609 a of the retrieval item table 620 a in whichretrieval items are stored, display style 610 a of the result ofretrieval and image data 611 a of the information lens. The lens areaand the focus area of the information lens can be determined byproviding the columns of X and Y coordinates 603 a and 604 a of anorigin determinative of a position on image information in the column602 a of origin of lens, providing the focus area and the lens area withsimilar figures and predetermining a positional relation between thefocus area and the lens area.

In the present embodiment, examples of the shape of the information lensinclude rectangle, circle and polygon. However, a region enclosed by afree curve or a specified shape beforehand registered may be used inaccordance with image information to be subjected to retrieval. Forexample, in the case where a map is used as image information, a figurecan be used which represents administrative districts or an area along acertain road. Since the shape of the lens can thus be changed inaccordance with the object of retrieval, analysis adapted for theproperty of an area becomes possible.

The retrieval item table 620 a includes the columns of lens number 621a, item number 622 a, item 623 a, attribute 624 a, set value 625 a anddisplay flag 626 a of the result of retrieval. The image data storagetable 630 a may be integrated into the information lens parameter table600 a. However, when considering the fact that the table 600 a includestext or code information, it is preferable that the table 630 a isprovided in a separate storage area as in the present embodiment.

FIG. 8 shows the structure of the hit link table 700. The table 700includes the columns of DB number 701, record number 702, image number703, coordinate 704 and leading address 705 of a retrieval result table710 in which the results of retrieval are stored. The table 710 includesthe columns of sheet number 711 and retrieval result flag 714. The sheetnumber column 711 is used when the retrieval with function sheet whichwill be mentioned later on. The column 711 is provided with the numberequal to the number of function sheets generated.

FIG. 9 shows the structure of a correspondent point setting table storedin the image-image link information DB 730. The table 730 includes thecolumns of consecutive number 731 peculiar to a pair of correspondentpoints, coordinates 732 of a correspondent point on the first imageinformation indicating the pair of correspondent points, and coordinates733 of a correspondent point on the second image informationcorresponding to the coordinates 732.

A quantitative retrieval with information lens will be explained alongthe following procedure.

First, the DB information reading process 810 shown in FIG. 1 will beexplained using FIG. 10 in reference to a displayed example shown inFIG. 14. Next, the parameter setting process 820 and the imageinformation generating process 830 will be explained using FIG. 11 inreference to displayed examples shown in FIGS. 15 and 16. Further, aretrieval condition setting process as a part of the parameter settingprocess 820 will be explained using FIG. 12 in reference to a displayedexample shown in FIG. 17. Finally, the DB retrieval process 840 will beexplained using FIG. 13 and a displayed example of the result ofretrieval will be shown in FIG. 18.

FIG. 10 shows a flow chart of the DB information reading process 810.

When the system is started, the contents of the columns of the imagename 202 and type of image 203 in the image information DB 200 aredisplayed as map menus on the display device 5 (step 8010). When the mapname of a map to be subjected to retrieval is inputted by the inputdevice (step 8015), the corresponding image information is read from theimage information DB 200 and is displayed on the display device 5 (step8020). At this time or simultaneously, the image number is read.

In the present embodiment, only the map name is inputted. However, ifone can be specified from various maps, an image number associated witha map to be subjected to retrieval may be inputted when the map isdesignated by the selection of a reduced image, the selection of aschematically represented menu, and so forth.

Next or when the name of a DB to be subjected to retrieval is inputtedby the input device 3 (step 8025), the DB number 101 or 111 of a DBcorresponding to the inputted DB name is read from the attributeinformation DB. On the basis of the image number (or map name) and theDB number is read link information of the link information DB 300 (step8030). And, a DB retrieval format table 500 a is generated referring toitems of the attribute information DB and the attributes of the items(step 8035).

As has been mentioned above, the format for DB retrieval is generatedreferring to the attribute information DB. Therefore, a user can set aretrieval item even if the user does not know the contents of theattribute information DB beforehand.

A menu for retrieval and the read DB information are displayed on thedisplay device 5 and there turns into a waiting condition until there isan input from the user (step 8040). An example of the display screen atthis time is shown in FIG. 14. As shown in FIG. 14, the menu includes amenu 1010 for designating a map and a DB to be subjected to retrievaland a menu 1013 for making a retrieval with information lens. The menu1013 includes the areas of “GENERATE” 1014 a, “CONDITION” 1015 a and“END” 1016. When each area is selected, the corresponding mode is set.

The menu 1010 shown in FIG. 14 includes an area 1011 for designating amap to be subjected to retrieval and an area 1012 for designating anattribute information DB to which the reference is to be made. Whileseeing a reduced map displayed in the area 1011, the user can select thecorresponding DB from the DB's displayed in the area 1012. The menu 1013includes an area 1014 a for indicating the start of retrieval using aninformation lens, an area 1015 a for indicating the setting or change ofa retrieval condition, and an area 1016 for indicating the end of thesystem.

The selection of an area in the menu is realized by moving an areadesignating input mark or a cursor 1017 into the area and inputting aninstruction for area selection by an input device such as mouse. An areato be selected is called button. In the following, the selection of anarea is expressed as selecting a button in order to make a distinctionfrom the depression of a button of an input device.

An area 1018 is an area for displaying image information that includes amap section showing apartment buildings and single family residencesdisplayed with the names of the residents NM1-NM4 and NM6-NM8, forexample. Although the names NM1, etc. are shown displayed for only a fewresidences, it is understood that names are displayed for each of theresidences and buildings and that additional names for the otherbuildings shown are omitted from the figure for clarity or DBinformation.

Next, the parameter setting process 820 will be explained using FIG. 11.

After the menu and the DB information have been displayed, as shown inFIG. 14, the judgement is made as to whether or not the menu 1010 isselected (step 8045). The flow returns to step 8010 if the menu isselected and proceeds to step 8050 if the menu is not selected.

In step 8050, the judgement is made as to whether or not the button 1016is selected. If the button 1016 is selected, the processing iscompleted. If the button 1016 is not selected, the flow proceeds to step8055.

In step 8055, the judgement is made as to whether or not the button 1014a or 1015 a is selected. If the button 1015 a is selected, a retrievalcondition setting/changing mode is set or the flow branches to step 8060to perform the processings of steps 8060, 8065 and 8070 and the flowthen proceeds to step 8080. If the button 1014 a is selected, aretrieval mode is set or the flow goes to step 8075. If neither thebutton 1014 a nor 1015 a is selected, the flow goes to step 8078.

In step 8060, a condition setting mode is first set. Next, in the casewhere the tables 600 a and 620 a have not been generated, the tables 600a and 620 a are generated and a lens number of the column 601 a is setwhile a menu 1020 for designating the shape of an information lens, asshown in FIG. 15, is displayed on the menu 1013. In the case whereanyone in the menu 1020 is selected or after a fixed time has beenelapsed after the display of the menu 1020, the former display shown inFIG. 14 is restored. The menu 1020 includes a plurality of areas fordesignating the shape. For example, areas 1021, 1022 and 1023 are menusfor designating a rectangular area, a circular area and a freely setarea, respectively, as the shape of an area to be retrieved.

In the case where the tables 600 a and 620 a have been generated, thereoccurs a condition of waiting for the selection of an information lensto be subjected to the change of the retrieval condition. At this time,the display urging the user to select may be made in such a manner thatinformation lenses selectable by the user are displayed with differentcolors, as shown by shaded portions 11036 a and 11036 b in FIG. 16B.

In step 8065, image data of the information lens is generated referringto the parameter table 600 a generated in step 8060 and is displayed.Further, a retrieval condition settlement button 1031 and a conditionsetting/changing button 1032 (see FIG. 16A) are displayed on the menu1013. The retrieval condition settlement button 1031 and the conditionsetting/changing button 1032 will be explained in conjunction with step8070.

The information lens is displayed by circles 1033 a and 1035 a and asemicircle 1034 a shown in FIG. 16A. Reference numeral 1033 denotes alens area, numeral 1035 a focus area, and numeral 1034 a retrievalcondition setting/changing button. The function of the button 1034 issimilar to that of the button 1032.

In step 8070, a retrieval condition is inputted from the input device 3and parameters are set into the parameter table 600 a. The details ofstep 8070 will be explained using FIG. 12.

When the button 1032 or 1034 shown in FIG. 16A is selected, a window1040 a for DB retrieval condition setting, as shown in FIG. 17A, isdisplayed on the display device 5 (step 80701). This window is generatedreferring to the table 620 a. In step 80702, a display style, a setvalue for a retrieval item and an instruction for whether or not theresult of retrieval for the retrieval item should be displayed areinputted from the input device 3. The input of those values is accepteduntil the settlement menu 1031 is selected. In the case where thesettlement menu 1031 is selected (step 80703), the display of the window1040 a is erased and the inputted parameters are stored into the tables600 a and 620 a (step 80704).

An example of the window 1040 a will now be explained briefly by use ofFIG. 17B. The window 1040 a is composed of input areas 1041 and 1042 ofdisplay style, input areas 1043 to 1047 for set values for retrievalitems, and areas 1048 to 1052 for setting the presence/absence ofdisplay of the retrieval results for the retrieval items 1043 to 1047.

When the settlement menu 1031 is selected, the set conditions are storedinto the tables 600 a and 620 a (step 80704) and the information lens isdisplayed on the display device 5 (step 80705).

As has been mentioned above, the values of the table 600 a are set orchanged. At this time, in the case where there are a plurality of imageinformation read in the process 810, image information made an object ofdetermination of the focus area is set.

On the other hand, in the case where the result of judgement in step8055 shows that the menu or button 1014 a is selected, a predeterminedvalue is set into the table 600 a if one information lens is not set inthe table 600 a, and an information lens is displayed on the basis ofthe set value (step 8075). Further, image information made an object ofdetermination of the focus area is set. In the case where neither themenu 1014 a nor the menu 1015 a is selected, the judgement is made as towhether or not there is the input of movement or modification for theinformation lens (step 8078). If there is the input, the flow proceedsto step 8080. If there is no input, the flow returns to step 8040.

With the above processing, the information lens is displayed and theflow proceeds to step 8080. In step 8080, the positions of the lens areaand the focus area are detected and these areas are determined and arestored into the table 600 a. If a relation between the lens area and thefocus area is defined beforehand, the storage of the origin and area ofthe lens area and the size of the focus area suffices.

Next, the image information generating process 830 is performed in steps8085 and 8090 so that image information to be displayed in the lens areais generated and displayed on the display device 5.

The second image information read in the process 810 is modified on thebasis of the parameter concerning the lens area and the magnifying ratewhich are stored in the parameter table 600 a and the correspondence ofthe first image information to the second image information which isstored in the image-image link information DB 730, so that imageinformation in the lens area is generated. The modifying process will beexplained later on.

In step 8090, an image generated in step 8085 is displayed on thedisplay device in a composite form with the corresponding portion of thefirst image information. Since the overlaying or overlapping display ofa plurality of image information can be realized by the prior art, theexplanation thereof will be omitted.

A displayed example of first image information composed with secondimage information in a lens area is shown in FIG. 18. The first imageinformation is displayed in the display area 1018 and the second imageinformation or image information in lens area is displayed in the area1033 a in a composite form with the first image information. Displayedcontents 1071 a to 1077 a are image information generated on the basisof the second image information.

The process for modifying the second image information will be explainedusing FIGS. 19 to 22. The modifying process the two following processes:

(1) a “magnifying process” available in the case where a user grazessteadily at an overlaying area or in the case where a plurality of DB'shave a correspondence to one image information; and

(2) a “transforming process” available in the case where the deviationof image information is caused, as shown in FIG. 20A, when a pluralityof image information are overlaid on the basis of the origin of imageinformation stored in the image information DB 200.

In the magnifying process, image information in lens area is generatedin a version magnified on the basis of the magnifying rate of the table600 a. The magnifying rate is set to 1 beforehand. In the case where theimage information in lens area is to be generated by the magnifyingprocess, a magnifying rate is set in step 8070. A displayed example ofimage information subjected to the magnifying process is shown in FIG.19. Marks 1068 a and 1069 a indicate that a correspondence is made todifferent DB's.

In overlaying the first image information with the second imageinformation, the display area and display style (ormagnification/reduction) of the second image information can be setarbitrarily on the basis of the user's instruction, as mentioned above.Therefore, the present invention provides the following effects.

(a) Since an area overlaid with the second image information is limitedto only a necessary portion of the first image information, it ispossible to prevent the overlaying of image information from causing theincrease of in amount of the displayed information in the whole of thesame area, which increase is caused in the prior art. As a result, it ispossible to avoid a problem that, due to the excess of information orthe overlaying of characters or symbols on a map, the user may take aconsiderable time for searching for necessary information or mayoverlook the necessary information.

(b) Since there is always displayed the whole of the first imageinformation which the second image information is to overlay, the usercan designate precisely an area to be overlaid with the second imageinformation while seeing the first image information.

On the other hand, the transforming process available in the case wherefirst image information and second image information are displayedoverlaying with a deviation from each other, as shown in FIG. 20A, isperformed for displaying both the image information with a matchingcorrespondence of image information to each other, as shown in FIG. 20B.

In FIGS. 20A and 20B and FIG. 21, the coordinates 732 and 733 ofcorrespondent points of first and second image information stored in theimage-image link DB 730 are indicated by white and black dots,respectively. The transformation of the second image information willnow be explained using FIG. 21.

There are selected three (for example, correspondent points 2105, 2106and 2107) from among correspondent points of the first image informationincluded in the lens area (hereinafter referred to as correspondentpoints on first image information), and the reference is made to theimage-image link information DB 730 to determine correspondent points2101, 2103 and 2102 of the second image information (hereinafterreferred to as correspondent points on second image information) whichcorrespond to the selected correspondent points. Such two sets ofcombinations of three points are selected and the second imageinformation is modified in accordance with an algorithm which will bementioned later on. A method of selecting correspondent points from thefirst image information includes a method in which a user designates thecorrespondent points through the input device 3 and a method in whichthose of correspondent points nearer to the centroid of the lens areaare selected.

An example of an algorithm for transformation of overlaying imageinformation will now be described. In the described transformation, atriangle formed by a set of three correspondent points on the secondimage information is transformed to coincide with a triangle formed bycorrespondent points on the first image information corresponding to thethree points in the set. For example, in FIG. 21, a triangle formed bycorrespondent points 2101, 2103 and 2102 on the second image informationis transformed to coincide with a triangle formed by correspondentpoints 2105, 2106 and 2107 on the first image information.

The computational expression for the transformation will now be shown.As shown in FIG. 22, it is assumed that correspondent points on thefirst image information are A(Xa, Ya), B(Xb, Yb) and C(Xc, Yc) andcorrespondent points on the second image information are A′(Xa′, Ya′),B′(Xb′, Yb′) and C′(Xc′, Yc′). At this time, the correspondent pointsA′, B′ and C′ on the second image information are corrected to coincidewith the correspondent points A, B and C on the first image information.As a result, any point D′(Xd′, Yd′) included in the triangle A′B′C′formed by the correspondent points on the second image information iscorrected to turn into a point D(Xd, Yd) calculated by the followingequations:

Xd=T(Xb−Xa)+S(Xc−Xa),

Yd=T(Yb−Ya)+S(Yc−Ya)  (1)

where

T=(s 2*Xd′−s 1*Yd′)/(t 1*s 2−t 2*s 1)

S=(t 2*Xd′−t 1*Yd′)/(t 2*)s 1−t 1*s 2)

t 1=Xb′−Xa′

t 2=Xc′−Xa′

s 1=Yb′−Ya′

s 2=Yc′−Ya′.

Besides the above method, the conventional two-dimensional graphictransformation method can be used. With the use of the above-mentionedtransforming process, the following effects are obtained.

(1) Since a mismatching between two image information is reduced,useless information in the overlaying areas is reduced, thereby reducinga user's misperception.

(2) Since a correspondence between two image information is visuallyrepresented, the user can make a rapid judgement based thereon.

Finally, the DB retrieval process 840 will be explained using FIG. 13.

In the DB retrieval process 840, a search for primary link informationincluded in a focus area determined in step 8080 shown in FIG. 11 ismade using the link information DB 300 and the searched-out primary linkinformation is stored into the hit link table 700 (step 8095). The focusarea is an area corresponding to first image information or second imageinformation set in step 8065 or 8075 shown in FIG. 11.

The DB retrieval is made for the primary link information determined instep 8095 on the basis of the attribute information DB's 100 and 110 anda DB retrieval condition stored in the table 620 a (step 80100). In thepresent embodiment, the DB retrieval is made after the retrieval of anarea. However, in the case where the number of primary link informationis great, the abstraction of primary link information may be made afterthe DB retrieval.

As the result of DB retrieval, a flag is set into the column 705 of thetable 700 for the corresponding primary link information (step 80105)and the primary link information having a set flag in the column 705 isdisplayed (step 80110). Marks 1061 a to 1067 a shown in FIG. 18 are linkinformation concerning the primary link having a set flag in the column705

Information of the attribute information DB concerning the primary linkinformation having a set flag in the column 705 is read referring to thecolumns 701 and 702 (step 80115). Referring to the display style 610 aof the table 600 a and the flag 626 a of the table 620 a indicatingwhether or not the result of DB retrieval should be displayed, data fordisplay of the result of DB retrieval is generated from the read DBinformation (step 80120). The generated data is displayed on the displaydevice 5 (step 80125).

A displayed example of the result of DB retrieval is shown in FIG. 18.The result of DB retrieval is displayed in an area 1081. As shown inFIG. 18, values set in step 80702 of FIG. 12 are such that a full nameand an address are displayed as the result of DB retrieval and thedisplay style is a style of displaying a display area in a card form forthe corresponding primary link information. As another display style, amethod in which the result of DB retrieval is displayed in one table maybe used. In this case, the area 1041 shown in FIG. 17B is selected. Thearea 1081 for displaying the result of retrieval is set at the peripheryof the lens area 1033 a so that individual results of retrieval do notoverlap, and the display is made so that a connection with thecorresponding marks 1061 a to 1067 a is recognizable.

Also, the result of retrieval and relevant information such as imageinformation as shown in FIG. 18 are stored into the work file 2 a.Namely, each information stored in the external memory 2 is selectivelystored into the work file 2 a through the above-mentioned qualitativeretrieval and is then used in the quantitative retrieval with functionsheet which will be mentioned later on.

In the present invention, the correspondence of the result of DBretrieval to a position on a map corresponding thereto is displayed, asmentioned above. Therefore, even if information for an individualportion is displayed, there is no fear that a user may lose sight of thecorrespondence.

The quantitative retrieval 900 with the function sheet shown in FIG. 1is composed of the DB information reading process 910 and thequantitative retrieval process 920. In the quantitative retrieval 900which will be mentioned in the following, the work file 2 a generated inthe qualitative retrieval 800 is used. The contents of the work file 2 aare substantially the same as the contents stored in the external memory2. Therefore, the same reference numerals as those used in conjunctionwith the external memory 2 will be used.

In the process 910, a data format of DB retrieval condition is generatedas a DB retrieval format table 500 b on the basis of the attributeinformation DB's 100 and 110 in which attribute information is stored.The process 910 further includes reading, from the work file 2 a, theimage information DB 200 in which image information is stored and thelink information DB 300 in which link information for linking the imageinformation and the attribute information DB with each other is stored.The read DB information is displayed on the display device 5.

The process 920 includes a function sheet generating instructiondetecting process 921, a retrieval condition changing instructiondetecting process 922, a function sheet generating/changing process 923and a DB retrieval process 914. A function sheet in the presentinvention is the composition of image data designating an area to beretrieved for image information and a retrieval condition represented bytext information. Namely, the text information included in the functionsheet qualitatively sets a retrieval condition, and the image dataincluded therein directly sets an area of application of the retrievalcondition on image information which is an object of retrieval. Theimage data includes image data which is used for only the designation ofan area to be retrieved and image data in which a retrieval conditionrepresented by text information is converted into an image and isdisplayed in a composite form.

The retrieval condition represented by text information includes alocational requirement, a DB requirement and a combinative requirement.The locational requirement is text information concerning an area to beretrieved which is inputted by operating image data. The DB requirementis text information concerning a retrieval condition which is used inmaking the DB retrieval. The combinative requirement is text informationwhich, when the retrieval is made using a plurality of function sheets,indicates in what relation a locational requirement and a DB requirementpossessed by a certain function sheet should be retrieved with alocational requirement and a DB requirement possessed by which offunction sheets. The locational requirement may be inputted directly bytext information from the input device 3.

Thus, a positional retrieval condition can be inputted by operatingimage data displayed on the display device 5. Therefore, it is possibleto input an area to be retrieved without referring to text informationrepresentative of the position of image data being displayed, therebyfacilitating the input of the positional retrieval condition.

In the process 920, the contents of a function sheet generatinginstruction or a retrieval condition changing instruction, when theinstruction is inputted, are detected by the process 921 and the process922 and the process 923 is performed. In the process 923, initial valuesconcerning a function sheet are inputted by an input from the inputdevice 3 by a user, the reference to the table 500 b and the setting ofa beforehand prepared value or the preceding used value, and a functionsheet parameter table 600 b is generated by use of the inputted initialvalues. And, image data of the function sheet is generated on the basisof the table 600 b and is displayed in a composite form with imageinformation to be subjected to retrieval. A locational requirement isinputted by operating the image data of the function sheet and is storedinto the table 600 b.

Thus, the preceding set value can be set as an initial value in thegeneration of a function sheet. Therefore, in the case where a part of aretrieval condition is to be changed, a condition setting time can beshortened. As a result, a retrieval time is shortened so that aneffective retrieval is made.

In the process 924, the DB retrieval is made on the basis of the table600 b generated in the process 923 and with reference to the DB 100, theDB 110, the DB 200 and the DB 300. Further, the result of retrieval isstored into the hit link table 700 and the image data of the functionsheet and the result of retrieval are displayed.

The correspondence of the process 910, the process 920 and processes 921to 924 to flow charts shown in FIGS. 24 to 27 is as follows. Namely,FIGS. 24 and 25 show the flow of the overall processing of thequalitative retrieval 900 as a whole. The details of the process 910 areshown in FIG. 24 and the details of the process 920 are shown in FIG.25. The processes 921 and 922 included in the process 920 correspond tostep 9055 shown in FIG. 25, the process 923 corresponds to steps 9060 to9075, and the process 924 corresponds to step 9080. Further, the detailsof step 9075 of FIG. 25 are shown in FIG. 26 and the details of theprocess 924 are shown in FIG. 27.

FIG. 23 shows the structure of the function sheet parameter table 600 b.

The table 600 b shown in FIG. 23 includes the columns of sheet number601 b peculiar to a function sheet, origin of the function sheet(reference point of the function sheet area) 602 b, shape of sheet 605b, size of sheet 606 b, leading address 609 b of a retrieval item table620 b in which retrieval items are stored, display style 610 b of theresult of retrieval, leading address 611 b of a sheet image data table630 b in which image data of the function sheet is stored, andcombinative requirement 612 b representing the relation of a DBrequirement possessed by each function sheet. The column of origin ofsheet 602 b is composed of the columns of X and Y coordinates 603 b and604 b of the origin. The column of size of sheet 606 b is composed of,for example, columns representing the lengths of height 607 b and width608 b, respectively. The column of combinative requirement 612 b shows apointer (or partner in operation) and is composed of a sheet numbercolumn 613 b in which the sheet number of a function sheet for linkingretrieval conditions is stored and an operator column 614 b in which anoperator for those conditions is stored. A retrieval conditionrepresented by characters and an area indicating an area of applicationof the retrieval condition are generated as image data of the functionsheet on the basis of the parameters set in the table 600 b and thegenerated image data is displayed on the original image information.

In the present embodiment, examples of the shape of a function sheetinclude rectangle, circle and polygon. However, a region enclosed by afree curve or a specified shape beforehand registered may be used inaccordance with image information to be subjected to retrieval. Forexample, in the case where a map is used as image information, a figurecan be used which represents administrative districts or an area along acertain road. Since the shape of the sheet can thus be changed inaccordance with the object of retrieval, analysis adapted for theproperty of an area becomes possible.

The table 620 b includes the columns of sheet number 621 b, item number622 b, item 623 b, attribute 624 b, set value 625 b and display flag 626b of the result of retrieval. The table 630 b includes the columns ofsheet number 631 b, image data 632 b for setting, and image data 633 bafter composition with retrieval condition.

A quantitative retrieval with function sheet will be explained in thefollowing procedure.

First, the process 910 shown in FIG. 1 will be explained using FIG. 24in reference to a displayed example shown in FIG. 28. Next, thequantitative retrieval process 920 will be explained using FIG. 25 inreference to displayed examples shown in FIGS. 29 and 30. Further, thefunction sheet generating/changing process 923 will be explained usingFIG. 26 in reference to displayed examples shown in FIGS. 30 and 31. TheDB retrieval process 924 will be explained using FIG. 27 and displayedexamples of the result of retrieval will be shown in FIGS. 32, 33 and34. Finally, the result of retrieval, in the case where a plurality offunction sheets are used, will be explained referring to a displayedexample shown in FIG. 35.

FIG. 24 shows a flow chart of the DB information reading process 910.Since steps 9010 to 9035 shown in FIG. 24 are similar to steps 8010 to8035 shown in FIG. 10 except that necessary information such as imagedata and attribute information DB is read from the work file 2 a, theexplanation thereof will be omitted. In step 9040, a menu for retrievaland read DB information are displayed as in step 8040 shown in FIG. 10.However, the display screen in this case has some difference from thatshown in FIG. 14. As shown in FIG. 28, a menu 1013 for retrieval withfunction sheet includes an area 1014 b for indicating the generation ofa function sheet, an area 1015 b for indicating the change of aretrieval condition, and an area 1016 for indicating the end of thesystem. The remaining is similar to FIG. 14.

After the menu and the DB information as shown in FIG. 28 have beendisplayed, there occurs a waiting condition until there is an input fromthe user, and the judgement is made as to whether or not the “END”button 1016 is selected (step 9045). In the case where the “END” buttonis selected, the processing is completed. In the case where the “END”button is not selected, the judgement is made as to whether or not amenu 1010 for changing a DB to be subjected to retrieval is selected(step 9050). In the case where the menu 1010 is selected, the flowreturns to step 9010. In the case where the menu 1010 is not selected,the quantitative retrieval process 920 shown in FIG. 25 is performed.

FIG. 25 is a flow chart of the quantitative retrieval process 920.

First or subsequent to step 9050 shown in FIG. 24, the contents of aselected menu are judged (step 9055). In the case where the selectedmenu is “GENERATE” 1014 b, step 9060 is performed. In the case where theselected menu is “CHANGE” 1015 b, step 9065 is performed. A functionsheet generating process will first be explained and a retrievalcondition changing process will thereafter be explained.

In the case where a function sheet is to be generated, preset values orvalues inputted from the input device 3 are set as initial values of thefunction sheet into the table 600 b shown in FIG. 23. As the initialvalues of the function sheet are set values which are capable of beingdisplayed in an area 1018 shown in FIG. 28. As a result, the size ofdisplayed image data for setting can be prevented from being too largeor too small for the area 1018 to display an object of retrieval.Therefore, no need to change a display magnification of the object ofretrieval is required until an area to be retrieved is settled. When themenu 1014 b is selected in step 9055, function sheet parameter tables600 b and 620 b are generated so that a sheet number is set into thecolumn 601 b of the table. Further, a menu 1020 for designating theshape of the function sheet, as shown in FIG. 29, is displayed on themenu 1013. The displayed menu 1020 includes a plurality of areas fordesignating the shape of the function sheet. In FIG. 29, the menu fordesignating the shape of an area to be retrieved includes a rectangulararea 1021, a circular area 1022 and a freely set area 1023.

One of the menus 1021 to 1023 is selected through the operation of acursor 1017 by the user and is stored as a parameter representative ofthe shape into the column 605 b of the table 600 b. Beforehand preparedvalues are set into the columns 602 b, 606 b and 610 b, and a leadingaddress of the table 620 b is set into the column 609 b. Also, valuesare set into the columns 622 b to 624 b of the table 620 b on the basisof the DB retrieval format table 500 b (step 9060). A valuecorresponding to the subtraction of “1” from the sheet number of thecolumn 601 b is stored as a beforehand prepared value into the column613 b and an operator OR is stored into the column 614 b. Then, the flowproceeds to step 9070. In the combinative requirement 612 b shown inFIG. 23, “0” is set into the column 613b for storage of a sheet numberof partner in operation since the leading sheet number 1 has nopreceding sheet which serves as the pointer. And, “OR” is set as anoperator into the column 614 b. There results in “0.OR.1=1”, that is, itis represented that the comparative requirement is the function sheet 1itself. A function sheet 2 shows that a logical product (AND) with thesheet 1 is made. For function sheets 3, 4, etc., “−1” and “NULL” are setas a sheet number of the pointer and an operator, respectively, therebyrepresenting that a comparative requirement is not yet set. In the casewhere several operations by using of sheets are defined, the sets ofoperations of sheets can be stored in the table 600 b in such a mannerthat a delimiter (0 in FIG. 23) is set in the clumn 613 b of a functionsheet stored in the lead of each set of operations.

In step 9070, image data of the function sheet is generated referring tothe function sheet parameter table 600 b generated in step 9060, and thegenerated image data is displayed in a composite form with the imagedata of the object of retrieval displayed in the DB display area 1018,as shown in FIG. 30A. Further, as shown in FIG. 30A, a settlement menu1031 and a menu 1032 for indicating the start of setting of a DBretrieval condition are displayed on the menu 1013. The image data ofthe function sheet used in step 9070 is image data displayed ininputting a locational requirement and is called image data for setting.On the other hand, there is image data used when the settled DBretrieval condition was composed on image information. This image datais called image data after composition.

What is important during the setting of a retrieval condition is tosimply display which portion of displayed image data of an object ofretrieval an area to be retrieved corresponds to. What is importantafter the composition of an image is the contents of image informationin the area to be retrieved. Therefore, to use different imageinformation as a function sheet in accordance with either the situationwhich is during the setting of the retrieval condition or the situationwhich is after the composition of the retrieval condition and the image,is effective for an operation of referring to image information.

In generation of the image data, each image data is into the functionsheet data table 630 b and a leading address of the table 630 b isstored into the column 611 b of the table 600 b.

As mentioned above, when a retrieval condition concerning an area to beretrieved is inputted, image data representing the area to be retrievedis displayed together with image data of an object of retrieval.Therefore, the user can abstract an intended object easily whileglobally grasping a map of the object of retrieval.

On the other hand, in the case where the retrieval is to be changed, amode of changing the retrieval condition is set and there occurs awaiting condition until a function sheet to be subjected to the changeof the retrieval condition is selected. When the function sheet isselected through the operation of the cursor 1017 by the user (step9065), step 9070 is performed. The details of step 9070 have alreadybeen mentioned.

Next, a process for setting the retrieval condition is performed (step9075) so that values are set into the parameter table 600 b. Then, a DBretrieval process is performed (step 9080) and the flow returns to step9040. According to the present invention, after the retrieval processhas been performed, a retrieval process can be performed again in astate in which the result of retrieval is being displayed. Therefore,the next retrieval condition can be set while referring to the precedingresult of retrieval or it is possible to easily make the retrieval in atrial-and-error manner. An example of the display screen at this time isshown in FIG. 34A. An area 1040 b is a DB retrieval condition settingwindow and the result of DB retrieval is displayed in an area 1075 b.According to the present invention, since another function sheet can begenerated again after the retrieval condition has been set, it becomespossible to make an analysis based on a retrieval with a retrievalcondition changed for each area. An example of the display screen atthis time is shown in FIG. 34B. Image data representing a locationalrequirement is displayed in areas 1036 b and 1037 b, and the result ofDB retrieval is displayed in areas 1076 b and 1077 b. The details of theareas 1037 b, 1040 b and 1075 b to 1077 b will be explained later on.

The details of the retrieval condition setting process 9075 are shown inFIG. 26.

In the retrieval condition setting process 9075, the judgement is madeas to whether or not the retrieval condition settlement menu 1031 shownin FIG. 30A is selected (step 90100). In the case where the menu 1031 isselected, the already inputted parameters are stored into the table 600b and the DB retrieval condition setting window, if it is displayed, iserased (step 90130).

In the present embodiment, step 90130 is performed in accordance with aninput for selecting the settlement menu 1031. However, step 90130 may beperformed in accordance with the detection of, for example, thedetachment of a finger from the button of a mouse or the detachment of apen from a tablet. Further, step 90130 may be performed in accordancewith an input for indicating the modification or movement of image dataof a function sheet, that is, the change of an area to be retrieved.

The setting of parameters necessary for retrieval into the tables 600 band 620 b and the resulting turn from the condition setting mode intothe settlement mode are called the composition of a function sheet.Image data of the function sheet displayed on the display device 5 whenthe function sheet was composed is the above-mentioned image data aftercomposition. A displayed example of the image data after composition isdenoted by reference numeral 1035 b in FIG. 30B.

In the case where it is determined as the result of the judgement madein step 90100 that the settlement menu is not selected, either (1) thesetting of a locational requirement or (2) the setting of a DB retrievalcondition is judged. A method of starting each setting will now beexplained using a displayed example of FIG. 30A in which image data of afunction sheet for the setting is shown.

(1) The setting of locational requirement is started when a portionother than an area 1034 b of an area 1033 b, in which image data forsetting is displayed, is selected by the cursor 1017. A method may alsobe used in which the setting of locational requirement is started inaccordance with the detection of the detachment of a finger from thebutton of a mouse or the detachment of a pen from a tablet and theboundary of an area to be retrieved is set and displayed in accordancewith the position of the cursor 1017 at that time and the position ofthe cursor 1017 when the mouse button was depressed. The setting of DBretrieval condition is started by selecting the area 1034 b or the area1032 on the menu 1013. Like the menu 1013, the area 1034 b is an areafor indicating the display of a DB retrieval condition setting window.

The provision of the menu for start of the setting of DB retrievalcondition in image data for setting a locational requirement, as shownin FIG. 30A, reduces the amount of movement of the cursor, therebyfacilitating the change-over of the setting of the retrieval condition.This is effective particularly in the case where the size of the displayscreen is large as compared with the amount of movement of the cursorper unit time.

When the user operates the image data for setting by use of the cursor1017 after the start of the setting of locational requirement has beenindicated, an image corresponding a function sheet subjected to changeis displayed on the display device 5 each time the position or size ofthe image data is changed (step 90110). Thereafter, until theinstruction for DB retrieval condition setting menu 1032 or theselection of the settlement menu 1031 is inputted, an area where theimage data for setting is being displayed is detected and an area of thegenerated function sheet to be retrieved is determined (step 90115).Values (X, Y coordinates and size of the area of the generated functionsheet) determined in step 90115 are stored into the columns 602 b and606 b of the table 600 b (step 90130).

(2) When the start of setting of the DB retrieval condition isindicated, a DB retrieval condition setting window 1040 b is displayedon the display device 5, as shown in FIG. 31A (step 90120). This window1040 b is generated referring to the table 620 b. In step 90125, adisplay style, a set value for a retrieval item and an instruction forwhether or not the result of retrieval for the retrieval item should bedisplayed are inputted into the window 1040 b from the input device 3.Further, a comparative requirement 612 b shown in FIG. 23 is inputted asa DB retrieval condition. A preset sheet number or a sheet number offunction sheet designated by the user by use of the cursor 1017 is usedas a pointer sheet number 613 b. An operator 614 b of sheets is set byan input from the keyboard or the selection from displayed menus. Thesevalues are stored into tables 600 b and 620 b in step 90130, as hasalready been mentioned. By setting a specified value beforehand definedas the pointer sheet number, a retrieval condition possessed by acertain function sheet is linked with a retrieval condition possessed bythe preceding generated function sheet on the basis of an operator ofsheets included in the certain function sheet and a retrieval process isperformed. As a result, there is no need to set the pointer sheet numbereach time.

As mentioned above, since the user can make an instruction for settingof the locational requirement after the start of the setting of DBretrieval condition is indicated so that the window 1040 b is displayedas shown in FIG. 31B, it is possible to freely select the order ofsetting a positional retrieval condition and a retrieval condition forDB retrieval.

The window 1040 b shown in FIG. 31B is composed of input areas 1041 and1042 of display style, input areas 1043 to 1047 for set values forretrieval items, and areas 1048 to 1052 for setting whether or not theretrieval results for the retrieval items 1043 to 1047 should bedisplayed. For example, the result of retrieval, in the case where aninstruction for DB retrieval of data showing the age of seventy or olderthan that is made for the area 1047, is shown in FIG. 33. Theexplanation of FIG. 33 will be made later on.

Next, the DB retrieval process 9080 will be explained using FIG. 27.

First, a search for primary link information included in the area to beretrieved determined in step 90115 shown in FIG. 26 is made using thelink information DB 300 and the searched-out primary link information isstored into the hit link tables 700 and 710 shown in FIG. 8 (step90200). In the case where a plurality of function sheets are generated,those ones of primary link information included in the link informationDB 300, which has a correspondence to image information displayed in thearea 1018, are stored into the tables 700 and 710. Each column of thesheet number 711 and the flag column 714 have “−1” set as an initialvalue. When data is stored into the table 700, “0” is set into each ofthe columns 711 and 714. On the basis of the determined linkinformation, primary link information having a flag of “0” in the column714 is displayed in the image information display area 1018 (step90205). A displayed example of link information is shown by marks 1061 bto 1069 b in FIG. 32A.

At the same time, the DB retrieval is made for the primary linkinformation determined in step 90200 on the basis of the attributeinformation DB's 100 and 110 and the DB retrieval condition stored inthe retrieval item table 620 b (step 90210). In the present embodiment,the DB retrieval is made after the retrieval of an area. However, in thecase where the number of primary link information is great, theabstraction of primary link information may be made after the DBretrieval.

As the result of DB retrieval, “1” is set into the column 711 of thetable 710 for the corresponding primary link information. Also,referring to the column 711 and the column 612 of the table 600, “1” isset into the column 714 for the corresponding record so that a flag isset (step 90215). Next, those ones of the primary link informationdisplayed in step 90205 having a set flag of “1” in the column 714 aredisplayed as they are, and those ones thereof having a value other than“1” in the column 714 are not displayed (step 90220). Marks 106 a, 106b, 106 c and 106 d shown in FIG. 32B are link information concerning theprimary link having the set flag in the column 714. In FIG. 32B, theprimary link information to be displayed in step 90205 and the primarylink information to be displayed in step 90220 are displayed withdifferent colors, thereby displaying different link informationsimultaneously on the same screen. However, the marks indicating thedifferent link information may be displayed with different shapes orthere may be used a method in which any link information is notdisplayed in step 9025 and only the primary link information obtained instep 90220 is displayed.

In the present invention, since primary link information included in anarea to be retrieved and primary link information abstracted from theearlier-mentioned primary link information in accordance with a DBretrieval condition are displayed, it is possible to know to what extentthe objects corresponding to a DB retrieval condition are included inobjects on an image map linked with DB information. Further, thereference to the outline of the already obtained result of retrieval canbe made in changing a retrieval condition.

Information of the attribute information DB concerning the primary linkinformation having a set flag in the column 705 is read referring to thecolumns 701 and 702 (step 90225). Referring to the display style 610 bof the table 600 b and the flag 626 b indicating whether or not theresult of DB retrieval should be displayed, data for display of theresult of DB retrieval is generated from the read DB information (step90230). The generated data is displayed on the display device 5 (step90235). A displayed example of the result of DB retrieval is shown inFIG. 33. The results of retrieval are displayed in areas 1071 b to 1074b. As is shown, values set in step 90125 are such that a full name andan address are displayed as the result of DB retrieval and the displaystyle is a style of displaying a display area in a card form for thecorresponding primary link information. A retrieval conditionrepresented by text information of the age of seventy or older than thatis displayed in an area 1034 b of the function sheet. In the presentembodiment, the display area of the card form and a corresponding pointsuch as the mark 106 a shown in FIG. 32B are linked in a predetermineddisplay form. However, a display method as shown in FIG. 35A, which willbe mentioned later on, can be used so that a card 2002 indicating therecord number 102 or 112 of the corresponding attribute information DBtakes a fixed position relative to a mark 2001 corresponding to linkinformation. Also, in the case where the area 1041 shown in FIG. 31B isselected in step 90125, the results of retrieval of a plurality of DB'sare displayed in one table.

Since the correspondence of the result of DB retrieval to a position ona map corresponding thereto is simply displayed, as mentioned above, theuser can confirm the individual result of retrieval without losing sightof a correspondence to image information.

Finally, displayed examples of the result of DB retrieval using aplurality of function sheets are shown in FIGS. 35A and 35B. In FIG.35A, two function sheets having substantially the same size are arrangedoverlapping. This overlapping shows that the DB retrieval is made with aplurality of retrieval conditions for one area. In FIG. 35B, functionsheets having different sizes are arranged in a partially overlappingmanner. In FIG. 35B is displayed the result of retrieval by a retrievalcondition in which a retrieval condition possessed by a function sheet2003 and a retrieval condition possessed by a function sheet 2004 arelinked by “AND”. Namely, in FIG. 35B are displayed those ones of primarylink information satisfying a locational requirement of the functionsheet 2003 and a locational requirement of the function sheet 2004 whichsatisfy a DB requirement of the function sheet 2003 and a DB requirementof the function sheet 2004. In FIG. 35A, the display is made so that acard 2002 indicating the record of the corresponding attributeinformation DB takes a fixed position relative to a mark 2001corresponding to link information.

According to the present invention, when text information having acorrespondence to image information is to be retrieved, there are made aquantitative retrieval which uses a retrieval key called an informationlens including the partial overlaying of the original image information(or map information) with another information for retrieval and aqualitative retrieval in which the retrieval is made with the originalimage information (or map information) being overlaid with a retrievalkey called a function sheet including the composition of a qualitativeretrieval condition and an image indicative of a range of application ofthe retrieval condition. Thereby, the following effects are obtained.Namely, since massive text information is filtered or subjected toscreening in the level of image by the quantitative retrieval, theamount of text information to be retrieved in more detail is reduced andhence a time required for retrieval is reduced. Also, Since theapplication range of the quantitative retrieval condition can be set byan image in the qualitative retrieval, a user can easily set theapplication range of the quantitative retrieval condition while takingthe whole of the original image information into consideration. Further,an effective information retrieval making the best use of the aboveeffect can be made by properly combining the quantitative retrieval andthe qualitative retrieval in accordance with the result of retrieval.

According to the present invention, with a construction in which anotherimage information is displayed in a form composed on image informationdisplayed on a screen, it is possible to grasp the other imageinformation in an intended area while seeing the state of theenvironment and to search for the intended area so that information inthat area is retrieved from a DB. At this time, such image compositionor generation image as will be mentioned in the following is possible.

1) The other image information including detailed information can becomposed in a local area on the image information displayed on thescreen. Thereby, the other detailed image information is added in only anecessary area on the original image information.

2) A magnified version of the other image information including detailedinformation can be composed in a local area on the displayed imageinformation. Thereby, it is possible to easily grasp the other imageinformation including detailed information, too.

3) The other image information including detailed information can becomposed in a local area on the displayed image information and within arange in which a distance from the center is fixed. Thereby, the otherimage information in the fixed range around an intended point isdisplayed always.

According to the present invention, since a positional retrievalcondition can be inputted by merely operating image informationdisplayed on a display device, it is possible for the user to input anarea to be retrieved without referring to text informationrepresentative of the position of the image information being displayed,thereby facilitating the input of the positional retrieval condition.

The preceding set value can be set as an initial value in generating afunction sheet. Therefore, in the case where a part of a retrievalcondition is to be changed, a condition setting time can be shortened.By providing a representative point representing an object of imageinformation, a retrieval throughput at the time of retrieval of primarylink information from an area to be retrieved is reduced, therebyshortening a retrieval time. Since the shape of a function sheet can bechanged in accordance with an object of retrieval, analysis adapted forthe property of an area becomes possible.

Since the format for DB retrieval is generated referring to an attributeinformation DB, the user can set a retrieval item even if the user doesnot know the contents of the attribute DB beforehand.

What is important during the setting of a retrieval condition is torepresent which portion of displayed image information of an object ofretrieval an area to be retrieved corresponds to. What is importantafter the composition of image information with a function sheet is thecontents of image information in the area to be retrieved. In thepresent invention, therefore, it is possible to use different imageinformation as a function sheet in accordance with either the situationwhich is during the setting of the retrieval condition or the situationwhich is after the composition with the retrieval condition.

According to the present invention, when a retrieval conditionconcerning an area to be retrieved is inputted, image data representingthe area to be retrieved is displayed together with image data of anobject of retrieval. Therefore, it becomes easy to abstract an intendedobject while globally grasping a map of the object of retrieval.

According to the present invention, after a retrieval process has beenperformed, the retrieval process can be performed again in a state inwhich the result of retrieval is being displayed. Therefore, the nextretrieval condition can be set while referring to the preceding resultof retrieval. Namely, it is possible to easily make the retrieval in atrial-and-error manner.

Since another function sheet can be generated again after a retrievalcondition has been set, it becomes possible to make an analysis based ona retrieval with a retrieval condition changed for each area.

By providing a menu for start of the setting of DB requirement in imagedata for setting a locational requirement, the change-over of thesetting of a retrieval condition is facilitated. This is effectiveparticularly in the case where the size of the display device is largeas compared with the amount of movement of a cursor per unit time.

Since it is possible to make an instruction for setting of thelocational requirement even after the start of the setting of DBretrieval condition is indicated so that a retrieval condition settingwindow is displayed, it is possible to freely select the order ofsetting a positional retrieval condition and a retrieval condition forDB retrieval.

Since primary link information included in an area to be retrieved andprimary link information abstracted from the earlier-mentioned primarylink information in accordance with a DB retrieval condition aredisplayed, it is possible for the user to know to what extent theobjects corresponding to a DB retrieval condition are included inobjects on an image map linked with DB information. Further, the usercan refer to the outline of the result of retrieval in changing aretrieval condition.

Since the correspondence of the result of DB retrieval to a position ona map corresponding thereto is displayed on the screen, the user canconfirm the individual result of retrieval without losing sight of acorrespondence to image information.

What is claimed is:
 1. Retrieval area definition information stored on a computer-readable storage medium for retrieving an attribute information linked with an image information, comprising: a pair of positional coordinate values for specifying a reference point of the retrieval area and area form information for indicating form of said retrieval area and size of the form in which a part of said image information is overlaid on a display displaying another image information; and a retrieval condition for retrieving said attribute information linked with a part of said image information included in said retrieval area, said retrieval condition being stored with a correspondence to said pair.
 2. Retrieval area definition information according to claim 1, wherein shapes indicated by the area form information include a rectangle, a circle, a polygon, a free curve closed area and a registered specific shape.
 3. Retrieval area definition information according to claim 1, further comprising: magnification rate information for the image in the retrieval area when displayed on the display device.
 4. Retrieval image data stored on a computer-readable storage medium for retrieving an attribute information linked with an image information, comprising: a retrieval condition represented by text format for retrieving said attribute information; and a pair of positional coordinate values and area form information defining an area range for applying to said retrieval condition and overlaying said image information on a display device, to retrieve said attribute information included in said area range, said pair being stored with a correspondence to said retrieval condition.
 5. Retrieval image data according to claim 4, wherein shapes indicated by the area form information include a rectangle, a circle, a polygon, a free curve closed area and a registered specific shape.
 6. Retrieval area definition information according to claim 1, further comprising: link information for linking the pair of positional coordinate values with a separate image file storing a shape image of the retrieval area.
 7. Retrieval image data according to claim 4, further comprising: link information for linking the pair of positional coordinate values with a separate image file storing a shape image of the retrieval area.
 8. Retrieval image data according to claim 4, further comprising: magnification rate information for the image in the retrieval area when displayed on the display device.
 9. A table for retrieving text data on image, the table being stored on a computer-readable medium, the table comprising: retrieval area information for defining retrieval target area in the image; retrieval condition information for defining retrieval condition by specifying attribute of the text data, the information being stored with linked to the retrieval area information; and the text data including the attributes in text form and positional information on the image, wherein the retrieval area information is used to extract first text data having the positional information within the defined retrieval target area from the text data, and the retrieval condition linked with the retrieval area information is used to extract second text data having the attribute specified by the retrieval condition from the first text data.
 10. A method implemented by a computer for retrieving text data on image, comprising: storing retrieval area information for defining retrieval target area in the image; storing condition information for defining retrieval condition by specifying attribute of the text data, the information being stored with linked to the retrieval area information; and preparing the text data including the attributes in text form and positional information on the image; extracting first text data having the positional information within the retrieval target area defined in the retrieval area information from the text data; extracting second text data having the attribute specified by the retrieval condition linked with the retrieval area information from the first text data; and displaying the second text data in text and displaying a mark corresponding to the positional information of the second text data on the image. 